Method and apparatus for signaling adaptive loop filter parameters in video coding

ABSTRACT

According to a method for Adaptive Loop Filter (ALF) processing of reconstructed video, multiple indicators are signaled in slice at an encoder side or parsed at a decoder side, where the multiple indicators are Adaptive Parameter Set (APS) indices associated with temporal ALF filter sets for the ALF processing. A current indicator is determined from the multiple indicators, where the current indicator is used to select a current ALF filter set. Filtered-reconstructed pixels are derived for the current block by applying the current ALF filter to the current block. In another method, if the ALF processing applied at a target sample requires an outside sample on other side of a target virtual boundary from the target sample, the outside sample is replaced by a padded sample.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of U.S. patent application Ser. No.16/817,707, filed Mar. 13, 2020, which claims the priority to U.S.Provisional Patent Application, Ser. No. 62/819,583, filed Mar. 16,2019, wherein the entire content and disclosure of each of the foregoingapplications is incorporated by reference into the present application.

FIELD OF THE INVENTION

The present invention relates to adaptive loop filter (ALF) signalingand processing in a video coding system. In particular, the presentinvention relates to ALF signaling using Adaptive Parameter Set (APS) ina video encoder or decoder and ALF processing across discontinuousboundaries.

BACKGROUND

Motion estimation is an effective inter-frame coding technique toexploit temporal redundancy in video sequences. Motion-compensatedinter-frame coding has been widely used in various international videocoding standards The motion estimation adopted in various codingstandards is often a block-based technique, where motion informationsuch as coding mode and motion vector is determined for each macroblockor similar block configuration. In addition, intra-coding is alsoadaptively applied, where the picture is processed without reference toany other picture. The inter-predicted or intra-predicted residues areusually further processed by transformation, quantization, and entropycoding to generate a compressed video bitstream. During the encodingprocess, coding artefacts are introduced, particularly in thequantization process. In order to alleviate the coding artefacts,additional processing has been applied to reconstructed video to enhancepicture quality in newer coding systems. The additional processing isoften configured in an in-loop operation so that the encoder and decodermay derive the same reference pictures to achieve improved systemperformance.

FIG. 1A illustrates an exemplary adaptive Inter/Intra video codingsystem incorporating in-loop processing. For inter-prediction, MotionEstimation (ME)/Motion Compensation (MC) 112 is used to provideprediction data based on video data from other picture or pictures.Switch 114 selects Intra Prediction 110 or inter-prediction data and theselected prediction data is supplied to Adder 116 to form predictionerrors, also called residues. The prediction error is then processed byTransformation (T) 118 followed by Quantization (Q) 120. The transformedand quantized residues are then coded by Entropy Encoder 122 to form avideo bitstream corresponding to the compressed video data. Thebitstream associated with the transform coefficients is then packed withside information such as motion, mode, and other information associatedwith the image area. The side information may also be subject to entropycoding to reduce required bandwidth. Accordingly, the data associatedwith the side information are provided to Entropy Encoder 122 as shownin FIG. 1A. When an inter-prediction mode is used, a reference pictureor pictures have to be reconstructed at the encoder end as well.Consequently, the transformed and quantized residues are processed byInverse Quantization (IQ) 124 and Inverse Transformation (IT) 126 torecover the residues. The residues are then added back to predictiondata 136 at Reconstruction (REC) 128 to reconstruct video data. Thereconstructed video data may be stored in Reference Picture Buffer 134and used for prediction of other frames.

As shown in FIG. 1A, incoming video data undergoes a series ofprocessing in the encoding system. The reconstructed video data from REC128 may be subject to various impairments due to a series of processing.Accordingly, various in-loop processing is applied to the reconstructedvideo data before the reconstructed video data are stored in theReference Picture Buffer 134 in order to improve video quality. In theHigh Efficiency Video Coding (HEVC) standard being developed, DeblockingFilter (DF) 130, Sample Adaptive Offset (SAO) 131 and Adaptive LoopFilter (ALF) 132 have been developed to enhance picture quality. Thein-loop filter information may have to be incorporated in the bitstreamso that a decoder can properly recover the required information.Therefore, in-loop filter information from SAO and ALF is provided toEntropy Encoder 122 for incorporation into the bitstream. In FIG. 1A, DF130 is applied to the reconstructed video first; SAO 131 is then appliedto DF-processed video; and ALF 132 is applied to SAO-processed video.However, the processing order among DF, SAO and ALF can be re-arranged.

A corresponding decoder for the encoder of FIG. 1A is shown in FIG. 1B.The video bitstream is decoded by Video Decoder 142 to recover thetransformed and quantized residues, SAO/ALF information and other systeminformation. At the decoder side, only Motion Compensation (MC) 113 isperformed instead of ME/MC. The decoding process is similar to thereconstruction loop at the encoder side. The recovered transformed andquantized residues, SAO/ALF information and other system information areused to reconstruct the video data. The reconstructed video is furtherprocessed by DF 130, SAO 131 and ALF 132 to produce the final enhanceddecoded video.

The coding process in HEVC is applied according to Largest Coding Unit(LCU). The LCU is adaptively partitioned into coding units usingquadtree. In each leaf CU, DF is performed for each 8×8 block and inHEVC Test Model Version 4.0 (HM-4.0), the DF is applies to 8×8 blockboundaries. For each 8×8 block, horizontal filtering across verticalblock boundaries is first applied, and then vertical filtering acrosshorizontal block boundaries is applied. During processing of a lumablock boundary, four pixels of each side are involved in filterparameter derivation, and up to three pixels on each side can be changedafter filtering. For horizontal filtering across vertical blockboundaries, unfiltered reconstructed pixels (i.e., pre-DF pixels) areused for filter parameter derivation and also used as source pixels forfiltering. For vertical filtering across horizontal block boundaries,unfiltered reconstructed pixels (i.e., pre-DF pixels) are used forfilter parameter derivation, and DF intermediate pixels (i.e. pixelsafter horizontal filtering) are used for filtering. For DF processing ofa chroma block boundary, two pixels of each side are involved in filterparameter derivation, and at most one pixel on each side is changedafter filtering. For horizontal filtering across vertical blockboundaries, unfiltered reconstructed pixels are used for filterparameter derivation and are used as source pixels for filtering. Forvertical filtering across horizontal block boundaries, DF processedintermediate pixels (i.e. pixels after horizontal filtering) are usedfor filter parameter derivation and also used as source pixel forfiltering.

Sample Adaptive Offset (SAO) 131 is also adopted in HM-4.0, as shown inFIG. 1A. SAO can be regarded as a special case of filtering where theprocessing only applies to one pixel. In SAO, pixel classification isfirst done to classify pixels into different groups (also calledcategories or classes). The pixel classification for each pixel is basedon a 3×3 window. Upon the classification of all pixels in a picture or aregion, one offset is derived and transmitted for each group of pixels.ALF is not adopted by the HEVC (High Efficiency Video Coding). However,ALF is being considered for the emerging video coding standard, namesVVC (Versatile Video Coding). The filter coefficients of ALF are derivedby minimizing the sum of the distortion between filtered samples andoriginal samples. Furthermore, the derived filter coefficients aresignaled in the bitstream with on/off control flags. Multiple filterscan be used in one slice and the filter selection includes implicitselection by block-based classification and explicit selection bysignaled syntax.

The coding tree block (CTB) based ALF scheme was proposed in JVET-K0382(M. Karczewicz, et al., “CE2-related: CTU Based Adaptive LoopFiltering”, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 andISO/IEC JTC 1/SC 29/WG 11, 11th Meeting: Ljubljana, SI, 10-18 Jul. 2018,Document: JVET-K0382), JVET-L0391 (N. Hu, et al., “CE2.3 and CE2.4:Fixed filters, temporal filters, CU-level control and low-latencyencoder for ALF”, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, 3-12 Oct.2018, Document: JVET-L0391) and JVET-M0429 (N. Hu, et al., “Coding treeblock based adaptive loop filter”, Joint Video Exploration Team (JVET)of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting:Marrakech, MA, 9-18 Jan. 2019, Document: JVET-M0429). According to CTU(coding tree unit) or CTB based ALF, an ALF filter set is selected andapplied to all blocks in a CTU or CTB. Each slice contains at most onenew set of signaled ALF filters and this filter set can be furtherreused in the following slices to reduce the overhead. The signalled ALFfilter sets are stored and updated as a first-in-first-out (FIFO) bufferand named as temporal filter sets. In CTB based ALF, for luma component,when ALF is applied to a luma CTB, the choice among 5 temporal or 1signaled filter sets is indicated. If one of temporal filter sets isselected, only the corresponding FIFO index is signaled. For chromacomponent, when ALF is applied to a chroma CTB, if a new filter issignaled for a slice, the CTB uses the new filter; otherwise, the mostrecent temporal chroma filter satisfying the temporal scalabilityconstraint in the FIFO is applied. After Adaptive parameter set (APS)was adopted in VTM4 (VVC Test Model 4), ALF filters are signalled in APSinstead of slice. For the slice-level temporal filter, the APSs areupdated as a first-in-first-out (FIFO) buffer.

The 360-degree video, also known as immersive video is an emergingtechnology, which can provide “feeling as sensation of present”. Thesense of immersion is achieved by surrounding a user with wrap-aroundscene covering a panoramic view, in particular, 360-degree field ofview. The “feeling as sensation of present” can be further improved bystereographic rendering. Accordingly, the panoramic video is beingwidely used in Virtual Reality (VR) applications.

The 360-degree virtual reality (VR) pictures may be captured using a360-degree spherical panoramic camera or multiple pictures arranged tocover all field of views around 360 degrees. The three-dimensional (3D)spherical picture is difficult to process or store using theconventional picture/video processing devices. Therefore, the 360-degreeVR pictures are often converted to a two-dimensional (2D) format using a3D-to-2D projection method, such as EquiRectangular Projection (ERP) andCubeMap Projection (CMP). Besides the ERP and CMP projection formats,there are various other VR projection formats, such as OctaHedronProjection (OHP), icosahedron projection (ISP), Segmented SphereProjection (SSP) and Rotated Sphere Projection (RSP) that are widelyused in the field.

For a 360° video, the layout for a specific projection format may haveone or more discontinuous edges. Applying the in-loop filters on thesediscontinuous edges directly may result in poor visual quality anddecreased coding efficiency because the accessed pixels (to bereferenced and/or filtered) across discontinuous edges are jointlyprocessed (filtered). For projection formats composed of a plurality offaces, no matter what kind of compact frame packing arrangement is used,discontinuities appear between two or more adjacent faces in the framepacked picture. For example, considering the 3×2 frame packingconfiguration 210 depicted in FIG. 2 , the three faces in the top halfare continuous in the 3D geometry, the three faces in the bottom halfare continuous in the 3D geometry. However, the top and bottom halves ofthe frame packed picture 210 are discontinuous in the 3D geometry. Ifin-loop filtering operations are performed across this discontinuity,face seam artifacts may become visible in the reconstructed video.

BRIEF SUMMARY OF THE INVENTION

A method and apparatus for Adaptive Loop Filter (ALF) processing ofreconstructed video are disclosed. According to this method,reconstructed pixels are received, where the reconstructed pixelscomprise a current block. ALF filters are received, where ALF filtersare signaled in Adaptive Parameter Set (APS) and each ALF APS has oneAPS index. Multiple indicators are signaled in slice at an encoder sideor parsed at a decoder side, where the multiple indicators are ALF APSindices associated with ALF filter sets for the ALF processing. Acurrent indicator is determined from the multiple indicators, where thecurrent indicator is used to select a current ALF filter set.Filtered-reconstructed pixels are derived for the current block byapplying the current ALF filter set to the current block. Thefiltered-reconstructed pixels are provided.

In one embodiment, the multiple ALF APS indices are signaled in a tilegroup level. In another embodiment, the multiple ALF APS indices aresignaled in a slice level. In yet another embodiment, the multiple ALFAPS indices are signaled in a Coding Tree Block (CTB) level. A selectedALF filter set indicated by a current indicator can be applied to allblocks in a Coding Tree Block (CTB). Furthermore, a new ALF filter setis allowed to be switched at a CTB level.

According to another method, one or more virtual boundaries in thecurrent picture are determined. Filtered-reconstructed pixels arederived for the current picture by applying the ALF processing to thecurrent picture, where if the ALF processing applied at a target samplerequires an outside sample across a target virtual boundary, the outsidesample is replaced by a padded sample. The filtered-reconstructed pixelsare provided.

In one embodiment, said one or more virtual boundaries in the currentpicture correspond to one or more discontinuous boundaries in targetpicture of a 360 video. In another embodiment, said one or more virtualboundaries in the current picture correspond to one or morediscontinuous boundaries in a target picture comprising a sub-picturewithin a main picture. In yet another embodiment, information regardingsaid one or more virtual boundaries in the current picture is signaledat an encoder side or parsed at a decoder side. The target virtualboundary may correspond to a vertical or a horizontal boundary.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A illustrates an exemplary adaptive inter/intra video encodingsystem incorporating DF, SAO and ALF in-loop processing.

FIG. 1B illustrates an exemplary adaptive inter/intra video decodingsystem incorporating DF, SAO and ALF in-loop processing.

FIG. 2 illustrates an example of 4×3 and 3×2 cubemap layout formations.

FIG. 3 illustrates an example of the ALF comprising a 5×5 filter and a7×7 filter, where “C” indicates a current reconstructed pixel beingfiltered.

FIG. 4 illustrates a flowchart of an exemplary ALF processing ofreconstructed video according to an embodiment of the present invention,where ALF filters are signaled in Adaptive Parameter Set (APS) andmultiple ALF APS indices are signaled in slice.

FIG. 5 illustrates a flowchart of an exemplary ALF processing ofreconstructed video according to an embodiment of the present invention,where if the ALF processing applied at a target sample requires anoutside sample on other side of a target virtual boundary from thetarget sample, the outside sample is replaced by a padded sample.

DETAILED DESCRIPTION OF THE INVENTION

The following description is of the best-contemplated mode of carryingout the invention. This description is made for the purpose ofillustrating the general principles of the invention and should not betaken in a limiting sense. The scope of the invention is best determinedby reference to the appended claims.

In JVET-N0438 (S-Y Lin, et al., “AHG12: Loop filter disabled acrossvirtual boundaries”, in Joint Video Exploration Team (JVET) of ITU-T SG16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Geneva, CH, 19-27Mar. 2019, Document: JVET-N0438), proposed method is disclosed todisable the in-loop filters across vertical and/or horizontal virtualboundaries in the picture. In JVET-N0088 (C-Y Chen, et al., “CE5-1:Adaptive loop filter with virtual boundary processing”, in Joint VideoExploration Team (WET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG11, 14th Meeting: Geneva, CH, 19-27 Mar. 2019, Document: JVET-N0088), atechnique for ALF with virtual boundaries (VBs) is disclosed to removethe required line buffer of adaptive loop filter (ALF). In ALF ofVTM4.0, seven luma line buffers and four chroma line buffers arerequired because of using 7×7 diamond filters with 4×4 block-basedclassification for luma component and 5×5 diamond filter for chromacomponent. The footprint for the 5×5 and 7×7 diamond filters (310 and320) are shown in FIG. 3 . In order to fully remove the line bufferrequirement, ALF with virtual boundary (VB) processing is disclosed asfollows: when a sample located at one side of a VB is filtered,accessing samples located at the other side of the VB is forbidden. Theoriginally required samples at the other side of the VB are replacedwith padded samples.

In the present invention, techniques for ALF signaling and ALFprocessing across virtual boundaries of 360 videos or pictures withsub-picture are disclosed.

Method 1: ALF Signaling

In JVET-M0429, the selected temporal filter is signaled by using theindex in APS FIFO. This will restrict the possibility or the combinationof using the coded APS for the current slice (tile group). Furthermore,it may introduce error propagation when APS is missing or sent induplication. In order to avoid these issues, using the APS index (APSID) in APS instead of using the index in APS FIFO to indicate theselection of temporal filters for ALF is disclosed in one embodiment. Inanother embodiment, signaling the selection of temporal filters for ALFusing APS ID can be used for CTB-based ALF. When multiple temporalfilters are allowed and switched at some level (e.g. CTB level), the APSIDs of temporal filters used in the current slice (tile group) aresignaled according to one embodiment of the present invention.

Method 2: ALF Processing Across Virtual Boundaries of 360 Videos

In JVET-N0088, ALF processing using virtual boundaries is proposed toavoid using the samples across the virtual boundaries in order to reducethe line buffer usage. In JVET-M0438, information regarding thediscontinuous edges due to different faces in 360 videos are signaled,and the in-loop filtering process can be disabled at these edges toavoid using uncorrelated samples to do filtering. In JVET-M0438, acontrol flag (i.e.,pps_loop_filter_across_virtual_boundaries_disabled_flag) is signaled. Ifthe flag indicates ALF is disabled across the virtual boundary, thenumber of virtual boundaries as well as the positions are signaled. Inthe present invention, a technique is disclosed to treat thesediscontinuous edges as virtual boundaries for ALF processing with VBprocess, instead of disabling in-loop filtering process for ALF with VBprocess. In other words, in-loop filtering is still applied to thosesamples near the discontinuous edges instead of disabling the in-loopfiltering for these samples according to one embodiment of the presentinvention. However, the virtual boundaries process as disclosed inJVET-N0088 is enabled according to one embodiment of the presentinvention to avoid using uncorrelated samples at the other side ofvirtual boundary for the in-loop filtering process.

In one example, when the ALF processing is applied at a target sampleposition and the footprint of the ALF filter crosses a discontinuousboundary of the picture, and the samples on the other side of thediscontinuous boundary are padded. Any padding technique, such asextending a boundary pixel value, can be used. The samples on the otherside of the discontinuous boundary are referred as outside samples inthis disclosure. The virtual boundaries process proposed in WET-N0088 isextended to the column directions according to one embodiment of thepresent invention. In some cases, there are some subpictures in one highresolution video. According to one embodiment of the present invention,the subpicture boundaries can be treated as virtual boundaries andvirtual boundaries process as disclosed in WET-N0088 is applied to thosesamples near these boundaries.

Any of the foregoing proposed methods can be implemented in encodersand/or decoders. For example, any of the proposed methods can beimplemented in an in-loop filtering module of an encoder and/or adecoder. Alternatively, any of the proposed methods can be implementedas a circuit coupled to in-loop filtering module of the encoder and/orthe decoder.

FIG. 4 illustrates a flowchart of an exemplary ALF processing ofreconstructed video according to an embodiment of the present invention,where ALF filters are signaled in Adaptive Parameter Set (APS) andmultiple APS indices are signaled in slice. The steps shown in theflowchart may be implemented as program codes executable on one or moreprocessors (e.g., one or more CPUs) at the encoder side. The steps shownin the flowchart may also be implemented based hardware such as one ormore electronic devices or processors arranged to perform the steps inthe flowchart. According to this method, reconstructed pixels arereceived in step 410, wherein the reconstructed pixels comprise acurrent block. ALF filters are signaled in Adaptive Parameter Set (APS)at an encoder side or parsed at a decoder side in step 420, wherein oneAPS has one APS index. Multiple indicators are signaled in a slice at anencoder side or parsed at a decoder side in step 430, wherein themultiple indicators are ALF APS indices associated with temporal ALFfilter sets for the ALF processing. A current indicator is determinedfrom the multiple indicators in step 440, wherein the current indicatoris used to select a current ALF filter set. Filtered-reconstructedpixels are derived for the current block by applying the current ALFfilter set to the current block in step 450. The filtered-reconstructedpixels are provided in step 460.

FIG. 5 illustrates a flowchart of an exemplary ALF processing ofreconstructed video according to an embodiment of the present invention,where if the ALF processing applied at a target sample requires anoutside sample on other side of a target virtual boundary from thetarget sample, the outside sample is replaced by a padded sample.According to this method, reconstructed pixels in a current picture arereceived in step 510. One or more virtual boundaries in the currentpicture are determined in step 520. Filtered-reconstructed pixels arederived for the current picture by applying the ALF processing to thecurrent picture in step 530, wherein if the ALF processing applied at atarget sample requires an outside sample on other side of a targetvirtual boundary from the target sample, the outside sample is replacedby a padded sample. The filtered-reconstructed pixels are provided instep 540.

The flowcharts shown are intended to illustrate an example of videocoding according to the present invention. A person skilled in the artmay modify each step, re-arranges the steps, split a step, or combinesteps to practice the present invention without departing from thespirit of the present invention. In the disclosure, specific syntax andsemantics have been used to illustrate examples to implement embodimentsof the present invention. A skilled person may practice the presentinvention by substituting the syntax and semantics with equivalentsyntax and semantics without departing from the spirit of the presentinvention.

The above description is presented to enable a person of ordinary skillin the art to practice the present invention as provided in the contextof a particular application and its requirement. Various modificationsto the described embodiments will be apparent to those with skill in theart, and the general principles defined herein may be applied to otherembodiments. Therefore, the present invention is not intended to belimited to the particular embodiments shown and described, but is to beaccorded the widest scope consistent with the principles and novelfeatures herein disclosed. In the above detailed description, variousspecific details are illustrated in order to provide a thoroughunderstanding of the present invention. Nevertheless, it will beunderstood by those skilled in the art that the present invention may bepracticed.

Embodiment of the present invention as described above may beimplemented in various hardware, software codes, or a combination ofboth. For example, an embodiment of the present invention can be one ormore circuit circuits integrated into a video compression chip orprogram code integrated into video compression software to perform theprocessing described herein. An embodiment of the present invention mayalso be program code to be executed on a Digital Signal Processor (DSP)to perform the processing described herein. The invention may alsoinvolve a number of functions to be performed by a computer processor, adigital signal processor, a microprocessor, or field programmable gatearray (FPGA). These processors can be configured to perform particulartasks according to the invention, by executing machine-readable softwarecode or firmware code that defines the particular methods embodied bythe invention. The software code or firmware code may be developed indifferent programming languages and different formats or styles. Thesoftware code may also be compiled for different target platforms.However, different code formats, styles and languages of software codesand other means of configuring code to perform the tasks in accordancewith the invention will not depart from the spirit and scope of theinvention.

The invention may be embodied in other specific forms without departingfrom its spirit or essential characteristics. The described examples areto be considered in all respects only as illustrative and notrestrictive. The scope of the invention is therefore, indicated by theappended claims rather than by the foregoing description. All changeswhich come within the meaning and range of equivalency of the claims areto be embraced within their scope.

The invention claimed is:
 1. A method for Adaptive Loop Filter (ALF)processing of reconstructed video, the method comprising: receivingreconstructed data of a current picture having a sub-picture; derivingfiltered-reconstructed data for the current picture by applying the ALFprocessing, wherein the deriving includes: determining that the ALFprocessing to be applied on a target reconstructed sample that is on oneside of a vertical sub-picture boundary requires an outsidereconstructed sample that is on another side of the vertical sub-pictureboundary, samples at the two sides of the vertical sub-picture boundarybeing uncorrelated, and in response to the determination that the ALFprocessing to be applied on the target reconstructed sample that is onone side of the vertical sub-picture boundary requires the outsidereconstructed sample that is on the other side of the verticalsub-picture boundary, using a padded sample in place of the outsidereconstructed sample for applying the ALF processing on the targetreconstructed sample; and providing the filtered-reconstructed data forthe current picture.
 2. The method of claim 1, wherein informationregarding the vertical sub-picture boundary in the current picture issignaled at an encoder side or parsed at a decoder side.
 3. The methodof claim 1, wherein the deriving further comprising: determining thatthe ALF processing to be applied on a second target reconstructed samplethat is on one side of a horizonal sub-picture boundary requires asecond outside reconstructed sample that is on another side of thehorizonal sub-picture boundary, and in response to the determinationthat the ALF processing to be applied on the second target reconstructedsample that is on one side of the horizontal sub-picture boundaryrequires the second outside reconstructed sample that is on the otherside of the horizontal sub-picture boundary, using a second paddedsample in place of the second outside reconstructed sample for applyingthe ALF processing on the second target reconstructed sample.
 4. Anapparatus for Adaptive Loop Filter (ALF) processing of reconstructedvideo, the apparatus comprising one or more electronic circuits orprocessors arranged to: receive reconstructed data of a current picturehaving a sub-picture; derive filtered-reconstructed data for the currentpicture by applying the ALF processing, wherein the deriving includes:determining that the ALF processing to be applied on a targetreconstructed sample that is on one side of a vertical sub-pictureboundary requires an outside reconstructed sample that is on anotherside of the vertical sub-picture boundary, samples at the two sides ofthe vertical sub-picture boundary being uncorrelated, and in response tothe determination that the ALF processing to be applied on the targetreconstructed sample that is on one side of the vertical sub-pictureboundary requires the outside reconstructed sample that is on the otherside of the vertical sub-picture boundary, using a padded sample inplace of the outside reconstructed sample for applying the ALFprocessing on the target reconstructed sample; and provide thefiltered-reconstructed data for the current picture.
 5. The method ofclaim 1, wherein the vertical sub-picture boundary corresponds to anedge between two faces of a 360-degree video.